SOW-BS033 - Communication Influence

NoteHow To Read This Note

This file holds a literature overview from the course Communication & Influence (SOW-BS033).

Easy navigation per paper the structure is as follows: - Paper Story: a quick story-form summary for optimised conceptualisation and memorisation. - Verbatim paper abstract - Key terms: quick glossary with frequently used key-terms and their easy explanation - Problem: sketches the problem current paper found and/or solves - Research Questions - Hypotheses - Study setup - Findings - Meaning - Discussion - Conclusion

Navigation - Use the Table of Contents to jump to a week or a specific paper. - The week headings structure the document, and the paper titles are the main visual dividers.

PS. I know these are very extensive, however, easy navigation of information was my intent

Table of Contents

Week 1 [The Social Construction of Belief]

Mildenberger (2017) - Beliefs about Climate Beliefs: The Importance of Second-Order Opinions for Climate Politics

DOI: 10.1017/S0007123417000321

Paper Story

The paper starts from a coordination problem in climate politics: people may hesitate to support climate action when they misread what others believe. Mildenberger and Tingley examine second-order climate beliefs across mass publics, political elites, and intellectual elites in the United States and China. They show that these beliefs are marked by egocentric bias and global underestimation of pro-climate positions, while beliefs about others’ rationales are much more shared. They then show experimentally that updating second-order climate beliefs can increase support for climate cooperation. The paper concludes that biased second-order beliefs are an important part of explaining climate policy inaction.

Verbatim Abstract

When political action entails individual costs but group-contingent benefits, political participation may depend on an individual’s perceptions of others’ beliefs; yet, detailed empirical attention to these second-order beliefs - beliefs about the beliefs of others - remains rare. We offer the first comprehensive examination of the distribution and content of second-order climate beliefs in the United States and China, drawing from six new opinion surveys of mass publics, political elites, and intellectual elites. We demonstrate that all classes of political actors have second-order beliefs characterized by egocentric bias and global underestimation of pro-climate positions. We then demonstrate experimentally that individual support for pro-climate policies increases after respondents update their second-order beliefs. We conclude that scholars should focus more closely on second-order beliefs as a key factor shaping climate policy inaction and that scholars can use the climate case to extend their understanding of second-order beliefs more broadly.

Key Terms

1. Core constructs
Term Very short definition in this paper
second-order beliefs beliefs about the beliefs of others
second-order climate beliefs beliefs about other people’s climate beliefs
first-order climate beliefs a person’s own climate beliefs
egocentric bias bias in second-order beliefs toward one’s own views
global underestimation of pro-climate positions systematic underestimation of how pro-climate others are
pro-climate positions beliefs or policy positions supportive of climate action
climate policy inaction lack of stronger climate policy action
2. Survey-specific terms
Term Very short definition in this paper
mass publics general-public survey respondents
political elites elite political actors surveyed in the paper
intellectual elites expert or intellectual elite respondents surveyed in the paper
United States one national context studied in the paper
China one national context studied in the paper

Problem

  1. Broader problem
  • When political action has individual costs but group-contingent benefits, participation may depend on people’s perceptions of others’ beliefs.
  1. Specific problem in this paper
  • Detailed empirical attention to second-order beliefs, especially second-order climate beliefs, remains rare.
  1. Why this problem matters
  • If second-order climate beliefs are misperceived, they may shape support for pro-climate policies and contribute to climate policy inaction.

Research Questions

  1. Overall research question(s)
  • How are second-order climate beliefs distributed across mass publics, political elites, and intellectual elites in the United States and China, and why do they matter for climate politics?
  1. Within-country second-order climate beliefs
  • How do American and Chinese publics perceive the distribution of climate beliefs and climate policy support within their own countries?
  1. Between-country second-order climate beliefs
  • How do American and Chinese publics perceive the distribution of climate beliefs in the other country’s population?
  1. Elite second-order climate beliefs
  • Does the egocentric bias found among mass publics also extend to intellectual elites and political elites?
  1. Experimental update of second-order beliefs
  • Does updating respondents’ second-order climate beliefs increase support for collective climate action?
  1. Rationales ascribed to the beliefs of others
  • What rationales do individuals ascribe to the climate beliefs of others?

Hypotheses

  1. Overall hypotheses
  • No explicit hypotheses stated.
  1. Survey-specific hypotheses
  • No explicit hypotheses stated for the survey components or the experiment.

Study Setup

  1. Overall empirical setup
  • Participants: six new opinion surveys of mass publics, political elites, and intellectual elites in the United States and China.
  • Design: descriptive surveys plus an embedded survey experiment.
  • Key variables: second-order climate beliefs, first-order climate beliefs, and support for pro-climate policies.
  • Manipulations/measures: survey questions on respondents’ own climate beliefs, beliefs about others’ climate beliefs, and an experimental update of second-order climate beliefs.
  • What this paper tests: the distribution and content of second-order climate beliefs and whether updating them shifts support for climate action.
  1. Survey components
Component Participants Design What this component tests
March 2014 US population survey US population, SSI, n=1,815 nationally representative survey within-country second-order climate beliefs in the United States
May 2014 MTurk survey US MTurk workers, n=1,131 non-representative survey US beliefs about Chinese climate beliefs and cross-national comparison
February 2015 Chinese population survey Chinese population, SSI, n=1,659 national survey within-country second-order climate beliefs in China
March 2015 US population survey US population, SSI, n=2,073 nationally representative survey with embedded survey experiment updated US estimates and the experimental update of second-order climate beliefs
March 2015 TRIP Snap Poll IR scholars, n=1,054 elite survey second-order climate beliefs among intellectual elites and beliefs about compliance with the US-China Climate Accord
August 2016 congressional staffer survey US congressional staffers, n=106 elite survey second-order climate beliefs among political elites

Findings

Within-country second-order climate beliefs
  • both publics underestimated the true fraction of their own population holding pro-climate positions.
  • respondents who personally held more pro-climate beliefs estimated more public agreement than respondents who personally disagreed.
  • Null findings: none explicitly stated for this component.
Between-country second-order climate beliefs
  • the US public underestimated the fraction of the Chinese public with pro-climate beliefs and preferences, and the Chinese public did the same for the US public.
  • there was less evidence of egocentric bias when estimating the distribution of beliefs among foreign publics.
  • Null findings: no explicit null effect stated beyond the weaker evidence for egocentric bias in foreign-public estimates.
Elite second-order climate beliefs
  • surveys of International Relations scholars and US congressional staffers replicated the pattern of egocentric bias and global underestimation.
  • among IR scholars, underestimation of Chinese support appeared linked to beliefs that the US would not, or should not, comply with the US-China Climate Accord.
  • Null findings: none explicitly stated for this component.
Experimental update of second-order beliefs
  • the treatment increased support for the treaty by 0.35 on the 0-10 compliance scale.
  • nearly 40% of the average treatment effect was attributed to changes in second-order beliefs about Chinese compliance expectations.
  • Null findings: the average treatment effect was smaller among conservatives, but no explicit null finding was stated in the cited results summary.
Rationales ascribed to the beliefs of others
  • differences in the rationales offered by those who believe climate change is happening and those who do not were substantively small and, in all but one case, statistically insignificant.
  • the one significant effect was that those thinking climate change is happening were more likely to say someone would use a science-based justification for why climate change is happening.
  • Null findings: aside from that one effect, the differences across respondents were statistically insignificant, including the political-actor prompt described in the results summary.

Discussion

  1. Theoretical contribution
  • The paper argues that second-order beliefs are a key factor in climate politics because they shape how people perceive the distribution of climate views and the prospects for coordinated action.
  • It extends work on second-order beliefs by showing egocentric bias and global underestimation of pro-climate positions across mass publics, political elites, and intellectual elites.
  • It also distinguishes between the distribution of climate beliefs and the content of climate rationales, showing more divergence in the former than in the latter.
  1. Practical implications
  • Misperceptions about how pro-climate others are may reinforce climate policy inaction.
  • Correcting second-order climate beliefs may increase support for collective climate action, including support for international climate cooperation.
  1. Limitations
  • The paper relies on survey evidence and an embedded survey experiment rather than observed long-run political behavior.
  • The elite samples are narrower than the mass-public surveys, so those results should be interpreted as corroborating evidence rather than full population estimates.
Week 2 [Interpersonal Communication & Social Norms]

Geiger (2016) - Climate of silence: Pluralistic ignorance as a barrier to climate change discussion

DOI: 10.1016/j.jenvp.2016.05.002

Paper Story

  • The paper starts from the puzzle that climate change is socially important but rarely discussed in everyday conversation. It tests whether pluralistic ignorance about others’ opinions creates self-silencing, first by examining naturally occurring perceptions among undergraduates and then by experimentally manipulating perceived agreement and disagreement. Across both studies, perceived disagreement reduces willingness to discuss climate change, and this pattern is explained mainly by expectations of appearing less competent, not less warm. The paper concludes that correcting pluralistic ignorance can remove a barrier to climate change discussion, especially among those who are already concerned.

Verbatim Abstract

Despite the importance of interpersonal public communication about climate change, most citizens rarely discuss the topic. In two studies, we find that inaccurate perceptions of others’ opinions (i.e. pluralistic ignorance) contribute to self-silencing among those concerned about climate change. Study 1 illustrates that those who are aware of others’ concern about climate change report greater willingness to discuss the issue than those with inaccurate perceptions of others’ opinions. Study 2 demonstrates that correcting pluralistic ignorance increases concerned participants’ willingness to discuss climate change. In both studies, pluralistic ignorance leads to self-silencing because perceptions that others do not share one’s opinion are associated with expecting to be perceived as less competent in a conversation about climate change. In contrast to previous research on confronting prejudice, in the present research expectations about being disliked did not explain self-silencing. We discuss the implications for self-silencing and promoting interpersonal communication about climate change.

Key Terms

1. Core constructs
Term Very short definition in this paper
pluralistic ignorance inaccurate perceptions of others’ opinions about climate change
self-silencing reduced willingness to discuss climate change
interpersonal public communication about climate change discussion of climate change with other people
climate change discussion discussion of climate change as the focal social behavior in the paper
2. Study-specific terms

Study 1

Term Very short definition in this paper
doubtful perceiving that most undergraduates doubt climate change
disengaged perceiving that most undergraduates are not engaged with climate change
polarized perceiving that undergraduates are split in their opinions
American public a more abstract and distant reference group used for comparison

Study 2

Term Very short definition in this paper
others’ alleged opinions about climate change experimentally provided information about what others think about climate change
opinion congruence the degree to which one’s opinion matches perceived opinions of others
concern increasing (vs. decreasing) information that concern is becoming more versus less like one’s own opinion

Problem

  1. Broader problem
  • interpersonal public communication about climate change can increase understanding, engagement, and consensus, yet such discussion is uncommon and climate change silence is widespread.
  1. Specific problem in this paper
  • The paper examines whether pluralistic ignorance about others’ opinions contributes to self-silencing in climate change discussion and whether correcting that pluralistic ignorance can remove this barrier.
  1. Why this problem matters
  • pluralistic ignorance can reduce willingness to share one’s opinion on climate change, whereas correcting it can reverse these effects.

Research Questions

  1. Overall research question(s)
  • Does pluralistic ignorance about others’ opinions contribute to self-silencing in interpersonal public communication about climate change, and can correcting that pluralistic ignorance increase willingness to discuss climate change?
  1. Study 1 research question(s)
  • Among undergraduates who do not doubt the existence of climate change, do perceptions of other undergraduates’ opinions predict silence on climate change?
  • Are perceptions of other undergraduates’ opinions, relative to perceptions of the American public, related to willingness to discuss climate change and anticipated evaluations by others?
  1. Study 2 research question(s)
  • Does experimentally manipulating perceptions of others’ opinions affect willingness to discuss climate change?
  • Do the same opinion cues provide inverse effects for those who doubt versus those who are concerned about climate change?
  • Do perceptions that concern about climate change is increasing versus decreasing affect willingness to discuss climate change?

Hypotheses

  1. Overall hypotheses
  • direct effect hypothesis: Participants will be less willing to talk about climate change when they perceive that their opinions are in the minority (vs. the majority).
  • mediation hypothesis: Individuals’ hesitation to discuss climate change in situations when they perceive their opinions are in the minority (vs. the majority) will be partly explained by expectations of appearing less warm in the conversation.
  • mediation hypothesis: Individuals’ hesitation to discuss climate change in situations when they perceive their opinions are in the minority (vs. the majority) will be partly explained by expectations of appearing less competent in the conversation.
  • null/alternative explanations considered: No explicit null/alternative explanations stated.
  1. Study 1 hypotheses
  • No explicit hypotheses stated.
  1. Study 2 hypotheses
  • moderation hypothesis: the effects of both experimental manipulations would be moderated by personal opinions about climate change.
  • null/alternative explanations considered: No explicit null/alternative explanations stated.

Study Setup

Study 1
  • Participants: 305 undergraduate students enrolled in introductory psychology classes at Pennsylvania State University; recruitment was based on pre-screening answers, and those who indicated they were Doubtful or a Nonbeliever were not recruited.
  • Design: not explicitly stated; a follow-up survey study using pre-screening-based opinion-perception groups and an imagined discussion scenario.
  • Key variables: perceptions of other undergraduates’ opinions, perceptions of the American public’s opinions, willingness to discuss climate change, and anticipated evaluations of appearing warm and competent.
  • Manipulations/measures: participants completed an online survey about an imagined group discussion situation; the primary predictor variable was the pre-screening category of perceptions of other students’ opinions, and the study measured anticipated evaluations and willingness to discuss climate change.
  • What this study tests: whether pluralistic ignorance predicts self-silencing among undergraduates who do not doubt climate change, and whether anticipated evaluations help explain that relationship.
Study 2
  • Participants: 194 students recruited from Pennsylvania State University introductory psychology classes; the sample included people with a full range of beliefs about climate change.
  • Design: experimental 2 x 2 design manipulating others' alleged opinions about climate change and whether concern was increasing versus decreasing, with personal opinions about climate change as a moderator.
  • Key variables: others' alleged opinions about climate change, changes in others’ alleged opinions over time, personal opinions about climate change, willingness to discuss climate change, and anticipated evaluations of appearing warm and competent.
  • Manipulations/measures: participants first reported their own concern about climate change, then received classroom clicker feedback about others’ opinions and changes over time; the study measured willingness to participate in a group discussion and anticipated evaluations by others.
  • What this study tests: whether experimentally correcting or reinforcing pluralistic ignorance changes willingness to discuss climate change, whether this depends on participants’ own opinions, and whether expectations of appearing warm and competent account for the effect.

Findings

Study 1
  • perceptions of other undergraduates’ opinions were related to willingness to discuss climate change; those who believed most undergraduates were doubtful were less willing to discuss than those with accurate perceptions that most were concerned, whereas the disengaged and polarized groups were not statistically less willing.
  • perceptions of other undergraduates’ opinions were associated with expectations of appearing competent, but not warm; the indirect effect through appearing competent was significant, whereas the indirect effect through appearing warm was not.
  • Null findings: perceptions of the American public’s opinions were not related to willingness to discuss climate change or to expectations of appearing competent or warm; the disengaged and polarized perception groups were not statistically less willing to discuss climate change than those with accurate perceptions.
Study 2
  • the effect was moderated by participants’ own concern; participants were more willing to discuss the topic when they were led to believe others would share their opinion than when they were led to believe they would not, and the effect was in the opposite direction for participants with opposing opinions.
  • the effect on expectations of appearing competent was moderated by participants’ own concern, and expectations of appearing competent, but not warm, mediated the relation between the interaction and willingness to discuss climate change.
  • Null findings: being led to believe that concern was increasing versus decreasing did not affect willingness to discuss climate change and did not affect expectations of appearing competent or warm; the effect on expectations of appearing warm was only marginal and was not supported.

Discussion

  1. Theoretical contribution
  • The paper argues that pluralistic ignorance promotes public silence on climate change by reducing willingness to discuss climate change when people perceive that relevant others disagree with them.
  • Across both studies, the paper’s account of self-silencing is that people expect to be respected less, that is, to appear less competent, rather than to be disliked or appear less warm.
  1. Practical implications
  • One practical implication is that discussion may be increased by correcting pluralistic ignorance among the majority who are concerned about climate change and by making the opinions of the relevant audience salient.
  • The paper also suggests that resilience in climate change discussion may be facilitated by improving communication skills or boosting efficacy about discussing climate change.
  1. Limitations
  • The paper notes that self-silencing should be assessed in more detail, because lack of discussion could reflect intentional silence or lack of personal interest.
  • It also points to the need for behavioral measures rather than relying only on self-report measures and suggests broader demographic testing beyond the present samples.
Week 3 [Driving, Nudging, and Boosting]

Dorresteijn (2013) - The daily 10 kcal expenditure deficit: a before-and-after study on low-cost interventions in the work environment

DOI: 10.1136/bmjopen-2012-002125

Paper Story

The paper starts from the idea that obesity and hypertension can be driven by very small everyday imbalances, so small lifestyle shifts at work may matter if they persist. The authors tested four low-cost workplace interventions in a university medical centre: stair-use prompts, reduced-salt soup prompts, lean-croissant prompts, and a change in the accessibility of margarine versus butter. Stair prompts modestly increased stair use, point-of-purchase food prompts did not clearly change food choices, and changing accessibility had the strongest effect on purchase behaviour. The paper concludes that in work environments, making healthy choices easier may be more effective than simply telling people what is healthier.

Verbatim Abstract

Objectives: To evaluate whether four types of low-cost interventions in the working environment can promote the small everyday lifestyle adaptations that can halt the epidemics of obesity and hypertension when maintained long term.

Design: A single-blind uninterrupted time-series intervention study consisting of four study periods: run-in (2 weeks), baseline (2 weeks), intervention (2 weeks), and after intervention 2 weeks).

Setting: University Medical Centre with over 11 000 employees, over 1000 hospital beds and over 2000 customers visiting the hospital restaurant each day.

Participants: Hospital staff and visitors.

Interventions: (1) Point-of-decision prompts on hospital elevator doors promoting stair use. (2) Point-of-purchase prompts in the hospital restaurant promoting reduced-salt soup. (3) Point-of-purchase prompts in the hospital restaurant promoting lean croissants. (4) Reversal of the accessibility and availability of diet margarine and butter in the hospital restaurant.

Main outcome measures: (1) Number of passages through 15 different parts of the hospital staircases. (2) Number and ratio of normal-salt and reduced-salt soup purchased. (3) Number and ratio of butter croissants and lean croissants purchased. (4) Number and ratio of diet margarine and butter purchased.

Results: Elevator signs increased the mean 24-h number of stair passages per measurement site (baseline: 992 ± 479 on week days and 208 ± 116 on weekend days) by 11.2% (95% CI 8.7% to 13.7%). This effect was maintained at least 2 weeks after the point-of-decision prompts were removed. Point-of-purchase prompts promoting low-salt soup and lean croissants did not result in altered purchase behaviour. The ratio between the purchase of margarine and butter was changed sevenfold ( p<0.01) by reversing the positions of these products in the hospital restaurant.

Conclusions: Healthy lifestyle adaptations in the working environment can be effectively promoted by making healthy choices easier than unhealthy ones. Educational prompts at points-of-decision moderately increase stair climbing, but do not affect healthy food choices.

Protocol registration: Clinicaltrials.gov identifier number: NCT01574040.

Key Terms

Core constructs
Term Very short definition in this paper
healthy lifestyle adaptations Small everyday changes in behaviour that may help prevent obesity and hypertension when maintained long term.
obesity Population-level weight gain linked here to a small chronic energy imbalance.
hypertension Public-health problem linked here in part to excess salt consumption.
excess salt consumption Salt intake high enough to contribute to hypertension and cardiovascular disease.
Study-specific terms
Term Very short definition in this paper
daily 10 kcal expenditure deficit The small average daily energy imbalance the paper uses to frame yearly weight gain.
working environment The workplace setting in which the low-cost interventions are implemented.
healthy choices The healthier options the environment can make easier than unhealthy ones.

Problem

  • Broader problem: Obesity and hypertension are framed as public-health epidemics partly driven by small everyday excesses in energy intake, low energy expenditure, and excess salt consumption.
  • Broader problem: The paper argues that seemingly small healthy lifestyle adaptations are difficult to adopt and rarely maintained long term.
  • Specific problem in this paper: The paper addresses whether several types of low-cost interventions in the working environment can stimulate the small everyday lifestyle adaptations that may help halt the epidemics of obesity and hypertension.
  • Why this problem matters: Adults spend approximately half their waking hours working, so the working environment may be an effective place to influence everyday lifestyle behaviour.
  • Why this problem matters: If small adaptations can be promoted in routine settings, they may contribute to long-term prevention of obesity and hypertension.

Research Questions

Overall research question(s)
  • Whether four types of low-cost interventions in the working environment can promote the small everyday lifestyle adaptations that can halt the epidemics of obesity and hypertension when maintained long term.
  • Whether several types of low-cost interventions in the working environment can stimulate the healthy lifestyle adaptations in everyday life that may contribute to halting the epidemics of obesity and hypertension.
Single study research question(s)
  • Whether point-of-decision prompts on hospital elevator doors promote stair use.
  • Whether point-of-purchase prompts in the hospital restaurant promote reduced-salt soup purchase.
  • Whether point-of-purchase prompts in the hospital restaurant promote lean croissant purchase.
  • How changing the accessibility and availability of diet margarine and butter in the hospital restaurant affects their purchase.

Hypotheses

Implicit directional expectations mentioned in the paper
  • Implicit: point-of-decision prompts on elevator doors were expected to promote stair use.
  • Implicit: point-of-purchase prompts were expected to promote reduced-salt soup and lean croissant choices.
  • Implicit: changing the accessibility and availability of diet margarine and butter was expected to affect purchase behaviour.

Study Setup

Single study
  • Participants: A dynamic study population of hospital staff and visitors at the University Medical Centre Utrecht.
  • Design: Single-blind time-series intervention study over 8 weeks, with run-in, baseline, intervention, and after-intervention periods of 2 weeks each.
  • Key variables: Stair use; purchase of normal-salt and reduced-salt soup; purchase of butter croissants and lean croissants; purchase of diet margarine and butter.
  • Manipulations/measures: Elevator-door point-of-decision prompts for stair use; soup-counter point-of-purchase prompts for reduced-salt cream soup; basket prompts for lean croissants; reversal of accessibility and availability of diet margarine and butter; outcomes measured with infrared interruption counters and the pay-desk computer system.
  • What this study tests: Whether several low-cost interventions in the working environment can stimulate healthy lifestyle adaptations relevant to obesity and hypertension by promoting stair use, lower-salt choices, lean croissant choices, and diet margarine over butter.

Findings

Single study
  • Stair-use prompts: Point-of-decision prompts on elevator doors increased stair passages by 11.2% after adjustment for restaurant customers (95% CI 8.7% to 13.7%); the increase remained 10.9% (95% CI 8.4% to 13.3%) in the after-intervention period.
  • Reduced-salt soup prompts: Promotion of reduced-salt cream soup did not change the number of normal-salt or reduced-salt soups sold, or their ratio.
  • Lean-croissant prompts: The ratio between lean and butter croissants was unchanged during the intervention period, but increased in the after-intervention period from 0.67 ± 0.18 to 0.90 ± 0.18 (p=0.02).
  • Accessibility manipulation: Reversing the positions of margarine and butter decreased the margarine-to-butter purchase ratio from 7.3 ± 1.9 to 1.1 ± 0.2 (p<0.01); the effect disappeared after the baseline situation was restored.
Null findings
  • No change in stair use was observed in the first hospital wing.
  • No increase in stair use was observed between floor levels 0 and 1.
  • The soup-purchase differences were in the hypothesised direction, but not statistically significant.
  • The lean-to-butter croissant ratio did not change during the intervention period.

Discussion

Main conclusion
  • Educational prompts at points of decision are moderately effective or ineffective for promoting a more healthy lifestyle.
  • The accessibility of healthy food items in the worksite restaurant had a major impact on purchase behaviour.
  • Small changes in everyday behaviour may on the long term have important impact on body weight and blood pressure.
Theoretical contribution
  • The paper compares four low-cost interventions simultaneously, allowing comparison of which type of intervention is most effective.
  • The authors argue that environmental accessibility appears more influential for food choice than point-of-purchase educational prompts in this setting.
  • For stair use, the observed effect was larger than the median effect reported in earlier elevator-based studies discussed by the authors.
Practical implications
  • Work environments may promote healthier behaviour by making healthy choices easier than unhealthy ones.
  • Point-of-decision prompts may be useful for increasing stair use.
  • Point-of-purchase health information alone may be insufficient to change food choices.
  • Changing accessibility and availability in workplace food environments may have stronger effects on purchase behaviour.
Limitations
  • The study was conducted in a single centre and was non-randomised.
  • Weather could not be stabilised and may have influenced food choices.
  • The interventions lasted 2 weeks, with only 2 weeks of post-intervention follow-up, so longer-term effects remain uncertain.
  • The authors could not distinguish stair use by employees versus visitors.
  • The authors could not distinguish stair climbing from stair descent.
  • No elevator-use data were obtained.
  • Weight and blood pressure were not measured, and follow-up was too short for those outcomes.
Week 4 [I-frames, S-frames, and System Change]

Chater (2023) - The i-frame and the s-frame: How focusing on individual-level solutions has led behavioral public policy astray

DOI: 10.1017/S0140525X22002023

Paper Story

The paper starts from the authors’ reversal of a position they had previously supported: the idea that many important public-policy problems can be solved cheaply and effectively by changing individual behavior without changing the surrounding system. Chater and Loewenstein argue that this i-frame focus has produced modest empirical results and, more importantly, has pushed behavioral scientists to define problems in individual rather than systemic terms. Using examples such as climate change, obesity, retirement savings, plastic waste, health care, privacy, misinformation, and addiction, they argue that many social harms are produced and maintained by systems, institutions, and commercial incentives. The paper concludes that behavioral science should contribute less to small individual fixes and more to designing, legitimizing, and implementing value-creating s-frame reform.

Verbatim Abstract

An influential line of thinking in behavioral science, to which the two authors have long subscribed, is that many of society’s most pressing problems can be addressed cheaply and effectively at the level of the individual, without modifying the system in which the individual operates. We now believe this was a mistake, along with, we suspect, many colleagues in both the academic and policy communities. Results from such interventions have been disappointingly modest. But more importantly, they have guided many (though by no means all) behavioral scientists to frame policy problems in individual, not systemic, terms: To adopt what we call the“i-frame,” rather than the“s-frame.” The difference may be more consequential than i-frame advocates have realized, by deflecting attention and support away from s-frame policies. Indeed, highlighting the i-frame is a long-established objective of corporate opponents of concerted systemic action such as regulation and taxation. We illustrate our argument briefly for six policy problems, and in depth with the examples of climate change, obesity, retirement savings, and pollution from plastic waste. We argue that the most important way in which behavioral scientists can contribute to public policy is by employing their skills to develop and implement value-creating system-level change.

Key Terms

Core constructs
Term Very short definition in this paper
i-frame A way of framing policy problems in individual terms, focusing on individuals and their thoughts and behaviors.
s-frame A way of framing policy problems in systemic terms, focusing on the system of rules, norms, and institutions.
i-frame policies Policies that use individual-level insights to change behavior without fundamentally changing the system.
s-frame policies Policies that alter the broader system, such as through rules, regulation, taxation, or institutional reform.
systemic action Concerted change at the level of systems rather than individuals.
Study-specific terms
Term Very short definition in this paper
individual-level solutions Interventions aimed at changing individuals without modifying the system in which they operate.
system-level change Change that creates value by altering the broader system in which behavior occurs.
crowd out The displacement of attention, support, or resources away from s-frame policies by focusing on i-frame solutions.
libertarian paternalism The approach associated with nudges that aims to improve choices while preserving freedom.
nudge A subtle adjustment intended to help fallible individuals make better choices without fundamentally changing the rules of the game.
single-action bias The tendency for taking one action to reduce perceived need for other actions.

Problem

  • Broader problem: Behavioral public policy has increasingly focused on individual-level interventions that try to improve choices without changing the broader system.
  • Broader problem: Many pressing public problems are generated and sustained by institutions, incentives, norms, and commercial actors rather than by individual error alone.
  • Specific problem in this paper: The paper argues that behavioral scientists have too often adopted the i-frame instead of the s-frame.
  • Specific problem in this paper: It addresses the concern that i-frame solutions not only have modest effects, but also divert attention and support away from more consequential system-level reform.
  • Why this problem matters: If problems are framed at the individual level, systemic interventions may be neglected even when they are more effective.
  • Why this problem matters: The framing choice influences what causes seem important, what policies appear legitimate, and which interests are protected.

Research Questions

Overall research question(s)
  • Has focusing on individual-level solutions led behavioral public policy astray?
  • What is the difference between the i-frame and the s-frame in public policy?
  • Why are i-frame interventions often modest in effect and potentially counterproductive in their policy consequences?
  • How can i-frame solutions crowd out attention, support, and resources for s-frame policies?
  • What is the most important way behavioral scientists should contribute to public policy?

Hypotheses

Paper-level conceptual claims
  • The paper-level claim is that the belief that many major social problems can be solved effectively at the individual level, without changing the system, was a mistake.
  • The paper-level claim is that i-frame interventions often produce modest results and encourage an individual rather than systemic framing of policy problems.
  • The paper-level claim is that focusing on i-frame solutions can deflect attention, support, and resources away from more effective s-frame policies.
  • The paper-level claim is that corporate actors often promote i-frame narratives in order to resist regulation, taxation, and other forms of systemic action.
  • The paper-level claim is that behavioral scientists can contribute most by helping design and implement value-creating system-level change.

Study Setup

Paper-level setup
  • Participants: Not applicable; the paper does not report a new participant sample.
  • Design: Conceptual target article combining theoretical argument, review of evidence, and case-study analysis.
  • Key variables: Not presented as one empirical variable set; the paper compares i-frame and s-frame approaches, their policy consequences, and their effects on support for reform.
  • Manipulations/measures: Not applicable as a single study design; the article synthesizes prior empirical findings, policy examples, and conceptual arguments.
  • What this paper examines: Whether behavioral public policy has focused too heavily on individual-level solutions, how this focus can crowd out system-level reform, and how behavioral science should contribute more to s-frame change.
Argument structure used in the paper
  • Framing distinction: The paper defines and contrasts the i-frame and the s-frame.
  • Mechanism section: It reviews arguments and evidence for why i-frame solutions can crowd out support for s-frame policies.
  • Case studies: It illustrates the argument with climate change, obesity, retirement savings, plastic waste, health care, and related domains.
  • Normative/professional claim: It argues that behavioral scientists should apply their skills more to the design, support, and implementation of system-level change.

Findings

Overarching findings
  • I-frame interventions have often yielded modest, small, or null effects in practice.
  • More importantly, focusing on i-frame interventions can crowd out attention, support, resources, and perceived need for s-frame reform.
  • Corporate interests repeatedly promote i-frame interpretations of social problems while lobbying against s-frame reform.
  • The paper argues that the strongest contribution of behavioral science to public policy lies in supporting system-level change rather than primarily designing individual-level fixes.
Case-oriented findings
  • Obesity: The paper states there is no empirical evidence causally connecting obesity to present-bias, and argues that food environments and industry design better explain the problem.
  • Obesity: I-frame interventions such as calorie-ordering prompts, incentives, and gym-payment schemes are described as disappointing or limited.
  • Retirement savings: Inadequate saving is not well explained by present-bias alone; pension-system design explains much more of the variation.
  • Retirement savings: Auto-enrollment and related i-frame reforms have not solved inadequate retirement saving because of leakage, low defaults, and unequal plan access.
  • Plastic waste: Industry has promoted recycling and anti-littering narratives despite very low recycling rates and limited large-scale success of i-frame approaches.
  • Plastic waste: S-frame interventions such as plastic-bag bans and extended producer responsibility are presented as more powerful and more resisted by industry.
  • US health care: High costs are attributed mainly to systemic features such as fee-for-service incentives and market fragmentation, not to worse individual health behavior.
  • US health care: I-frame tools such as reminders, apps, incentives, and improved plan choice are presented as weak substitutes for structural reform.
  • Additional domains: Educational inequality, privacy, misinformation, prescription-drug addiction, and gun violence are all used to argue that many social harms persist because systems reward, defend, or normalize them.
Null findings
  • No empirical evidence is cited linking obesity causally to present-bias.
  • Exercise incentives are described as having little evidence of impact on health.
  • Auto-enrollment only slightly accelerates pension enrollment and has not solved inadequate retirement saving.
  • There are no proven anti-littering initiatives operating at scale with a strong evidence base.
  • The article does not claim that all s-frame policies succeed; it explicitly notes that some can fail or backfire.

Discussion

Main conclusion
  • Behavioral public policy has focused too heavily on the i-frame, and this has often been both empirically disappointing and politically counterproductive.
  • Many major policy problems are better understood as system problems defended by institutional and commercial interests, not mainly as failures of individual choice.
  • The authors argue that behavioral scientists should aim higher and contribute more to value-creating s-frame reform.
Theoretical contribution
  • The paper reframes the central unit of analysis in behavioral public policy from the individual chooser to the system in which choices are made.
  • It argues that behavioral science is useful not only for explaining individual bias, but also for explaining why publics tolerate bad systems, why reforms face resistance, and how powerful actors exploit human psychology.
  • It extends the i-frame versus s-frame distinction into a broader research agenda about policy support, policy ergonomics, and institutional design.
Practical implications
  • Behavioral scientists should help increase public support for effective s-frame policies such as taxes, regulation, bans, and institutional redesign.
  • They should help design better policy-making processes, not just better individual-facing interventions.
  • They should study how to reverse industry exploitation of human psychology and how s-frame reforms can improve everyday i-frame decisions.
  • Many policies should be judged partly by whether they redesign incentives, defaults, conflicts of interest, and information environments at the system level.
Limitations
  • This is a conceptual target article, not a new empirical study.
  • The paper does not claim that all i-frame interventions are useless or that all s-frame interventions succeed.
  • Some of the strongest claims depend on synthesis and interpretation across domains rather than one direct empirical test.
  • The boundary between useful i-frame support and necessary s-frame reform remains partly a matter for future empirical and policy work.
Week 5 [The Credibility of Science Communication]

Meijers (2014) - Affirming belief in scientific progress reduces environmentally friendly behaviour

DOI: 10.1002/ejsp.2009

Paper Story

The paper starts from the paradox that people often know environmental problems are serious yet still fail to behave in environmentally friendly ways. Meijers and Rutjens argue that one reason may be the way science is portrayed in the media: when scientific progress is overstated, people may feel that science will solve environmental problems for them. Drawing on compensatory control theory, the authors propose that belief in scientific progress functions as an external source of order, reducing the need to exert personal control through environmentally friendly behavior. Across four experiments, they show that affirming scientific progress lowers disorder perceptions and reduces pro-environmental attitudes, intentions, and some behavioral choices, whereas questioning scientific progress can have the opposite effect.

Verbatim Abstract

Many people are reluctant to behave in environmentally friendly ways. One possible explanation might be that the motivation to behave in environmentally friendly ways is undermined by the way scientific progress is overstated in the popular media. Four experiments show that portraying science as rapidly progressing—and thus enabling society to control problems related to the natural environment and human health in the not-too-distant future—is detrimental to environmentally friendly behaviour because such a frame affirms perceptions of an orderly (vs chaotic) world. This in turn negatively affects the likelihood of engaging in environmentally friendly behaviour. Simultaneously, communication that questions (vs affirms) scientific progress leads to lower perceptions of order and consequential increases in environmentally friendly behaviour. These findings show that when the aim is to promote environmentally friendly attitudes and behaviour, it helps to not overstate scientific progress. Copyright © 2014 John Wiley & Sons, Ltd.

Key Terms

Core constructs
Term Very short definition in this paper
scientific progress The idea that science is rapidly advancing and will soon solve major environmental and health problems.
environmentally friendly behaviour Actions, choices, intentions, or attitudes that support environmental protection.
compensatory control theory (CCT) The theory that people are motivated to perceive the world as orderly and can satisfy this need through personal or external sources of control.
personal control The feeling that one can influence events and outcomes oneself.
external control The feeling that outside sources exert control over the world and keep it orderly.
perceptions of order The sense that the world is meaningful, structured, and nonrandom.
Study-specific terms
Term Very short definition in this paper
progress frame Media communication that portrays science as rapidly progressing and able to solve urgent problems.
environmental compensatory control hypothesis The idea that belief in scientific progress and environmentally friendly behaviour function as substitutable sources of order.
disorder perceptions Feelings that life is ruled by randomness, accident, or chaos.
hydraulic relation The compensatory relation in which stronger endorsement of one source of control reduces the need for another.
order-providing psychological mechanism A belief or behavior that helps restore a sense that the world is orderly.
environmentally friendly intentions Stated willingness to act in environmentally friendly ways.

Problem

  • Broader problem: Many people are reluctant to behave in environmentally friendly ways.
  • Broader problem: Popular media often portray science as rapidly progressing and close to solving environmental and health problems.
  • Specific problem in this paper: The paper addresses whether overstating scientific progress can ironically reduce environmentally friendly behavior.
  • Specific problem in this paper: It specifically examines whether a progress frame increases perceptions of order, thereby reducing motivation to exert personal control through environmentally friendly action.
  • Why this problem matters: If optimistic portrayals of science undermine pro-environmental behavior, then well-intended science communication may have counterproductive effects.
  • Why this problem matters: Understanding this mechanism matters for how environmental problems and scientific advances should be communicated to the public.

Research Questions

Overall research question(s)
  • Does affirming belief in scientific progress reduce environmentally friendly attitudes and behavior?
  • Does questioning scientific progress increase environmentally friendly attitudes and behavior?
  • Do belief in scientific progress and environmentally friendly behavior function as substitutable sources of order, as predicted by compensatory control theory?
Study-specific research question(s)
  • Study 1: Does affirming versus questioning scientific progress affect perceptions of disorder?
  • Study 2: Do heightened feelings of disorder increase environmentally friendly choices?
  • Study 3: Does engaging in environmentally friendly behavior increase feelings of personal control?
  • Study 4: Does affirming versus questioning scientific progress affect environmentally friendly attitudes, intentions, and behavior through differences in perceived order?

Hypotheses

Overall hypotheses
  • Affirming belief in scientific progress will increase perceptions of order and reduce environmentally friendly attitudes and behavior.
  • Questioning belief in scientific progress will lower perceptions of order and increase environmentally friendly attitudes and behavior.
  • Belief in scientific progress and environmentally friendly behavior function as substitutable sources of order, consistent with compensatory control theory.
Study-specific hypotheses
  • Study 1: Reading a message that questions, rather than affirms, scientific progress will increase feelings of disorder.
  • Study 2: Directly priming disorder, rather than order, will increase environmentally friendly choices.
  • Study 3: Engaging in environmentally friendly behavior will boost feelings of personal control.
  • Study 4: Communication affirming scientific progress will reduce environmentally friendly attitudes, intentions, and behavior, whereas communication questioning scientific progress will increase them, because of differences in perceived order.

Study Setup

Study 1
  • Participants: N = 103 university students; one partial completer excluded.
  • Design: Between-subjects experiment.
  • Key variables: Belief in scientific progress; perceptions of disorder.
  • Manipulations/measures: Participants read a counterfeit newspaper article that either affirmed or questioned scientific progress, then reported disorder perceptions and completed a manipulation check about science’s ability to solve climate-related problems.
  • What this study tests: Whether affirming versus questioning scientific progress changes feelings of disorder.
Study 2
  • Participants: N = 107; one participant excluded for incorrectly completing the prime.
  • Design: Between-subjects experiment.
  • Key variables: Primed order versus disorder; environmentally friendly attitudes and behavioral intentions.
  • Manipulations/measures: Participants completed a scrambled-sentence task that primed disorder or order, then completed a 12-item measure of environmental attitudes and intentions.
  • What this study tests: Whether disorder, compared with order, increases environmentally friendly choices.
Study 3
  • Participants: N = 58 university students; one participant excluded for failing to follow instructions.
  • Design: Between-subjects order-of-tasks experiment.
  • Key variables: Environmentally friendly behavior and generalized personal control.
  • Manipulations/measures: Participants either first completed environmental attitude/behavior tasks and then a personal-control questionnaire, or completed them in the reverse order. Environmental behavior included both attitude/intention items and a pollution-filter decision task.
  • What this study tests: Whether engaging in environmentally friendly behavior boosts generalized feelings of personal control.
Study 4
  • Participants: N = 43 university students; two multivariate outliers excluded.
  • Design: Between-subjects experiment.
  • Key variables: Belief in scientific progress; disorder perceptions; environmentally friendly attitudes, intentions, and consumer behavior.
  • Manipulations/measures: Participants read the same affirmed versus questioned scientific-progress newspaper articles as in Study 1, then reported disorder, completed six environmental attitude/intention items, and chose among product options in a shopping task where one option per category was organic.
  • What this study tests: Whether affirming versus questioning scientific progress affects environmentally friendly attitudes, intentions, and behavior through differences in perceived order.

Findings

Study 1
  • Affirming scientific progress increased belief in science’s ability to solve climate-related problems relative to questioning progress.
  • Affirming scientific progress reduced feelings of disorder compared with questioning progress.
Study 2
  • Priming disorder increased environmentally friendly attitudes and behavioral intentions compared with priming order.
Study 3
  • Engaging in environmentally friendly behavior increased generalized feelings of personal control.
  • There were no task-order differences in expressed environmental attitudes/intentions or in the environmental behavior task itself.
Study 4
  • Affirming scientific progress again reduced feelings of disorder relative to questioning progress.
  • Affirming scientific progress reduced environmentally friendly attitudes and intentions relative to questioning progress.
  • The effect of affirming versus questioning scientific progress on environmentally friendly attitudes and intentions was mediated by disorder perceptions.
  • Participants who read the article affirming scientific progress chose fewer organic products than participants who read the article questioning scientific progress, but this effect was only marginally significant.
  • Organic product choice correlated positively with environmentally friendly attitudes and intentions.
  • Disorder did not mediate the organic-choice effect.
Overall pattern across studies
  • The results support the compensatory-control account that belief in scientific progress can function as an external source of order.
  • When scientific progress is affirmed, the perceived need for personal control through environmentally friendly action is reduced.
  • When scientific progress is questioned, disorder perceptions rise, which increases environmentally friendly motivation and behavior.

Discussion

Main conclusion
  • The paper concludes that overstating scientific progress can ironically reduce environmentally friendly attitudes, intentions, and behavior.
  • A progress frame makes the world feel more orderly, which reduces the need to restore control through personal environmental action.
  • By contrast, questioning scientific progress can increase environmentally friendly behavior because it raises disorder perceptions and motivates personal action.
Theoretical contribution
  • The paper extends compensatory control theory by arguing that belief in scientific progress can function as an external source of order.
  • It shows that environmentally friendly behavior can function as a personal-control response when order is threatened.
  • The authors argue that affirming external sources of control has a downside: it can create passivity and inertia.
  • The paper also presents some of the first evidence for the functional value of affirming external order, namely that it actually enhances perceptions of order.
Practical implications
  • Science communication can have unintended downstream effects on environmental behavior.
  • If the goal is to encourage environmentally friendly action, communicators should avoid portraying science as omnipotent or as already close to solving environmental problems.
  • A more critical portrayal of the limits of scientific progress may, somewhat ironically, encourage people to take matters into their own hands.
Limitations
  • The authors note that urgency and outsourced responsibility are plausible alternative explanations, especially for Studies 1 and 4.
  • They argue these factors likely play some role alongside order motivation, rather than replacing it entirely.
  • The organic-choice effect in Study 4 was only marginal, and disorder did not mediate that outcome.
  • The paper calls for future research on how contradictory science communication, scientific uncertainty, and other external sources of control such as government or religion affect personal action.
  • The authors also note that rapid scientific progress may not always reduce environmental behavior; it depends on whether that progress instills order rather than potential disorder.
Week 6 [Resistance to Persuasion & Inoculation]

Basol (2020) - Good News about Bad News: Gamified Inoculation Boosts Confidence and Cognitive Immunity Against Fake News

DOI: 10.5334/joc.91

Paper Story

The paper starts from the problem that online misinformation is difficult to correct once it has spread and lodged itself in memory. Basol, Roozenbeek, and van der Linden argue that a better strategy may be prebunking: building resistance before exposure through psychological inoculation. They test a gamified inoculation intervention, Bad News, in which participants learn about six common misinformation techniques by playing the role of a fake-news producer in a simulated environment. The study replicates and extends earlier work by adding a randomized control group, more test items, and measures of confidence. The results show that playing Bad News reduces the perceived reliability of fake headlines and increases confidence in correct judgments, supporting the idea of a broad-spectrum inoculation against misinformation strategies.

Verbatim Abstract

Recent research has explored the possibility of building attitudinal resistance against online misinformation through psychological inoculation. The inoculation metaphor relies on a medical analogy: by pre-emptively exposing people to weakened doses of misinformation cognitive immunity can be conferred. A recent example is the Bad News game, an online fake news game in which players learn about six common misinformation techniques. We present a replication and extension into the effectiveness of Bad News as an anti-misinformation intervention. We address three shortcomings identified in the original study: the lack of a control group, the relatively low number of test items, and the absence of attitudinal certainty measurements. Using a 2 (treatment vs. control) × 2 (pre vs. post) mixed design (N = 196) we measure participants’ ability to spot misinformation techniques in 18 fake headlines before and after playing Bad News. We find that playing Bad News significantly improves people’s ability to spot misinformation techniques compared to a gamified control group, and crucially, also increases people’s level of confidence in their own judgments. Importantly, this confidence boost only occurred for those who updated their reliability assessments in the correct direc- tion. This study offers further evidence for the effectiveness of psychological inoculation against not only specific instances of fake news, but the very strategies used in its production. Implications are discussed for inoculation theory and cognitive science research on fake news.

Key Terms

Core constructs
Term Very short definition in this paper
misinformation False or misleading information spread online.
fake news Misleading or deceptive news-like content, often using common manipulation strategies.
psychological inoculation Pre-emptively exposing people to weakened doses of misinformation to build resistance against future persuasion.
cognitive immunity Resistance to misinformation generated through inoculation.
attitudinal resistance The ability to withstand persuasive or misleading messages.
attitudinal certainty Confidence that one’s judgments or attitudes are correct.
Study-specific terms
Term Very short definition in this paper
Bad News game A social-impact game in which players learn about six common misinformation techniques by producing fake news in a simulated environment.
broad-spectrum vaccine A generalized inoculation approach targeting misinformation techniques rather than one specific false claim.
prebunking A preventative strategy that builds resistance before exposure to misinformation.
perceived reliability Participants’ judgments of how reliable a fake headline or post seems.
misinformation techniques The six strategies taught in the game: impersonation, emotional language, polarization, conspiracy, discrediting, and trolling.
gamified control group A control condition using another game, here Tetris, to account for gamification effects without inoculation content.

Problem

  • Broader problem: Online misinformation poses a serious threat to science, society, and democracy.
  • Broader problem: False information is difficult to correct once encoded in memory, and repeated exposure can increase its perceived accuracy.
  • Specific problem in this paper: The paper addresses whether people can be proactively protected against misinformation through psychological inoculation.
  • Specific problem in this paper: It specifically examines whether the Bad News game effectively increases people’s ability to detect misinformation techniques and their confidence in those judgments.
  • Why this problem matters: If people can be inoculated against misinformation strategies before exposure, that offers a scalable alternative or complement to debunking and fact-checking.
  • Why this problem matters: This matters because online misinformation spreads rapidly and often outpaces corrective interventions.

Research Questions

Overall research question(s)
  • Does playing the Bad News game improve people’s ability to recognize misinformation techniques?
  • Does Bad News increase confidence in people’s reliability judgments about misinformation?
  • Can psychological inoculation work not only against specific fake stories, but against the broader strategies used to produce misinformation?
Study-specific research question(s)
  • Compared with a gamified control condition, does playing Bad News reduce perceived reliability of fake headlines from pre-test to post-test?
  • Compared with a gamified control condition, does playing Bad News increase attitudinal certainty about those judgments?
  • Does the intervention work similarly across political ideology, or is its effect moderated by ideology?

Hypotheses

Overall hypotheses
  • Playing Bad News will improve people’s ability to spot misinformation techniques, reflected in lower perceived reliability of fake headlines after the intervention compared with the control condition.
  • Playing Bad News will increase attitudinal certainty or confidence in reliability judgments.
  • Psychological inoculation via Bad News will work against the strategies used to produce misinformation, not just against a few specific fake items.
Study-specific hypotheses
  • Participants in the inoculation condition will show a larger pre-post decrease in perceived reliability of fake news items than participants in the gamified control condition.
  • Participants in the inoculation condition will show a larger increase in confidence in their judgments than participants in the control condition.
  • The paper also examines whether political ideology changes these effects, though no strong directional moderation hypothesis is foregrounded in the opening framing.

Study Setup

Single study
  • Participants: N = 197 recruited via Prolific Academic; inoculation condition n = 96, control condition n = 102.
  • Design: 2 (Bad News vs. control) x 2 (pre vs. post) mixed design.
  • Key variables: Perceived reliability of fake headlines; confidence in reliability judgments; political ideology.
  • Manipulations/measures: Participants rated 18 fictitious Twitter-style fake headlines on reliability and confidence before and after treatment. The treatment group played the Bad News game for about 15 minutes; the control group played Tetris for about 15 minutes.
  • Measurement structure: The 18 items covered 6 misinformation techniques with 3 items per technique. Reliability and confidence were each averaged into overall scales after internal-consistency and PCA checks supported single-factor treatment.
  • Analytic approach: One-way ANOVAs tested treatment effects on pre-post difference scores, and two-way ANOVAs tested possible ideology effects and interactions.
  • What this study tests: Whether active, gamified inoculation via Bad News reduces the perceived reliability of misinformation and increases confidence in those judgments compared with a gamified control condition.

Findings

Single study
  • Playing Bad News led to a significantly larger pre-post decrease in perceived reliability of fake news items than playing Tetris (d = 0.60).
  • Badge-level effects were observed across misinformation techniques, though effect sizes varied from small to moderate/large.
  • Playing Bad News led to a significantly larger increase in confidence in reliability judgments than the control condition (d = 0.52).
  • The confidence increase occurred only among participants who updated their reliability judgments in the correct direction.
  • The intervention worked as a broad-spectrum inoculation against misinformation techniques rather than only one specific fake claim.
  • Conservatives were more susceptible than liberals on the pre-test, consistent with earlier work.
Null findings
  • There was no significant main effect of political ideology on the treatment effect for reliability judgments.
  • There was no significant ideology-by-treatment interaction for reliability judgments.
  • There was no significant main effect of political ideology on the treatment effect for confidence judgments.
  • There was no significant ideology-by-treatment interaction for confidence judgments.
  • Participants who failed to update, or updated in the wrong direction, did not show a confidence gain.

Discussion

Main conclusion
  • The paper concludes that Bad News is an effective broad-spectrum inoculation intervention against online misinformation.
  • Compared with the control condition, it reduced the perceived reliability of fake headlines and increased confidence in correctly making those judgments.
  • The authors conclude that generalized inoculation can confer resistance not only to specific fake items, but to the manipulation strategies used to create them.
Theoretical contribution
  • The paper strengthens the case for broad-spectrum psychological inoculation by targeting misinformation techniques rather than only specific claims.
  • It extends earlier work by showing that attitudinal certainty or confidence may be an important mechanism in both prophylactic and therapeutic inoculation.
  • The authors also argue that the results support the idea that active, experiential inoculation can produce meaningful resistance effects.
Practical implications
  • Gamified prebunking interventions may be a useful tool for helping people resist fake news before exposure.
  • The absence of ideology interactions suggests the intervention may be applicable across political groups.
  • The authors suggest that active learning environments like Bad News may have practical value alongside more traditional fact-checking efforts.
Limitations
  • The control condition matched modality with another game, but not cognitive demands, so the study could not directly compare active inoculation with passive fact-checking or other cognitively similar interventions.
  • The study did not test whether the intervention improved detection of real news or changed actual online sharing behavior.
  • The study did not examine how long the inoculation effect lasts over time.
  • A small minority of participants updated in the wrong direction, which the authors note deserves future investigation.
  • The Prolific sample was likely not representative of the broader UK population.